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ABSTRACT 

The Johnson-O'Malley Act ( JOM) , passed by Congress in 
1934, authorized the Bureau of Indian Affairs (BIA) to contract with 
the states and other political entities for educational services to 
American Indians. Although the rationale for the JOM program was not 
understood well by a high proportion of the Indian patrons of public 
schools or by the school administrators, the nature of JOM funding 
and recent developments made the evaluation of these programs an 
inevitable requirement. In April, 1972, the Muskogee Area Office of 
the EIA sent the Indian Education Section of the Oklahoma State 
Department of Education a 1 page set of suggestions for evaluating 
and monitoring jOM projects. This document was shown in its entirety. 
About a month later the BIA office in Albuquerque, which handles the 
JOM program, forwarded to the Muskogee Area Office a similar and 
comprehensive questionnaire which was then forwarded to the Oklahoma 
State Department of Education. The returns showed an almost total 
lack of standardized evaluation test data^ Recommendations from the 
schools stressed the need for inservice training of personnel and 
changes in the program. (FF) 
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The Johnscn-n'Mai 1- V Act, passed h\- C.orgrccs .p. 193^ nnd amrndod 
in 1936, authorized t^i B-irc of Indian Affairs, among other t: ings, 
to contract with thi States and political fntiti***^ wiciiin Stacr*^, for 
educational strvicfs to ATTicrican Indians, For manv years t*H Johnson- 
O'Malley authority was us<jd. in addition t:> othvr piirpc30«. to compen- 
sate States and I'^cai school districts for tbr los-. t^f tav ri'Vc-n»i'- oc- 
casioned by the tax exempt status of Indian land. In 19:)8, iicvt vor, 
by amendmenc to Public Law , tl.is aspoct of thf Ft deral -State relat- 
ionship was brought under the "Federal impact" principle and States and 
school districts have- since b^cn CTmpen sated by funds administered by 
the U.S. Officer :>f Education. 

The Elementary and Secondary Education Act passed in 19^^, through 
its Title I, provides for the infusion of Federal funds into States and 
local educational agencies under a "poverty f.^nnula"; i.e. cn the basis 
of the number of pijpilj-, regardless of rac?, w' oso families have an 
annual income b^low an cstablis'^'/d line. Obviously many Indian pupils 
count toward this entitlement, but because tho\ are poor, not because 
they are Indian, 

The Johnson-O'Mallev Program. nowt?vt r, as it is now constituted, 
rests on a differ^^nt principle.. It provides additional funding to 
States and local school districts in order to enabU: thj latter to 
furnish to Indian pupils quality education which would not be possible 
solely through State and local resources ana to meet educational 
needs which are occasioned by such things as language and cultural dif- 
ferences. Johnson -O'Mal lev funds, then, are identifiable- as "Indian" 
in a way not trur of anv other. 

The above explanation is s*-t out in this mcrcuuction because there 
is strong evidence that the rationale for the Johnson-O'Mal lev program 
is not well understood either by a high proportion of the Indian patrons 
of the public schools or, indeed, by manv local public school administr- 
ators themselves. It seems likely that a cl*ar*.^r understanding of tht: 
purposes of the program on th'^, part of all conc**rnfd may sorv*' to draw 
the schools arif\ their Indian constituency ch?."»or rcgether in a common 
purpose. 

The Necessity for :laat 1 vn 

Given, thf'n, the nature of Johnson-O'Mal l^w funding, devolopments 
in recen*: times have made the evaluation of John5on-0*MaiU*y programs 
an inevitable requirement. One of the.sr* dev<? 1 »pTri^:nt s has been the grow- 
ing national understanding of the educational problrms of Arrerican Indian 
children and those of other disadvaniagf d min^^rUi-^s. Thi« increasing 



awareness has be^n rf-fUct.:d m c^.- ^nlt'J States Coigrtss- ^-cirti- 
cularly m the Scnatt . 

Over a recent two-year period a ^;>..ciai Svnait subc .rnmi tc --o on 
Indian education probed the offcrts of b^t- ch- Burcai of Jndian Affairs 
and the public schools and gave a v< ry adv. r?'. roport of what it found. 
One of its targets was tbo adnjini st rat ii' n of t ^. Johns 3n-0*Mal Icy pro- 
gram. Even more recently civil rights grrap^ drawn a brad on 
Johnson-O'Malley activities, claixang that appropriations w-^r- not being 
put to their intended ise and that Indian pcoplt^ ^ad littU cr nothing 
to say about it- 

In spite of Congressional critic is:n, and t^iie are many who feel 
that not all of it was warranted, t^e CcngT^ss h^s boen increasingly 
generous in its appropriation of Jc^nson•0'Mail^ y funds. At the same 
time, however, appropriations ccnraiittcr-s arf t*^nd;ng to require an 
accounting in the form of evidence that th^ additional money is being 
used well and is getting results. One can hardly quarn-l with such a 
requirement . 

The Johnson-0'Mall*jy Pre ft ram in Oklahoma 

During fiscal year 1971-72 now pas-t, the Bureau of Indian Affairs' 
contract with the State of Oklahoma was tor :?1.9 million. This con- 
tract covered services for the entire stat^, ot course, whereas this report 
is primarily concerned with the B.I. A '5 Muskogee Arta covering the eastern 
part of the state. The Division of Indian Education of the Oklahoma State 
Department of Education is support'rd by Jobnson-O'Mallry funds. Administr- 
ative costs are at a level of aboat $30 L!uri<anJ, covering mainly salaries 
of the director and the clerical staff. T>'0 State jf Oklahoma makes no 
charge for overhead costs such as cffic** spac'^. 

Other sizeable items were: $56 tnj'i^^and for inb<-rv'ice training of 
state and public school tnnploy^^'^-s ; 537 thoisarvJ for trav?l costs; $106 
thousand for summer programs in schcc^ls w'-iicV^ qua'iify during the r<!- 
gular school year; and $170 thousand for tb€ t'alaries cf 14 "coordinatcrs". 
Coordinators are persons who serv*^ in a liaison capacity between schools 
and Indian communitif^s and their rol'^ will br discussed m'jcr more fully 
later in this report. Th" 14 positions are about ^-qually divided between 
Muskogae and Anadarko areas. T^ere was also an (tc-m ct nearly $110 
thousand for school lunches for Indian children but this *'xp^nse will not 
recur this year since the United StatP* Dt^partroent of Agriculture is pick- 
ing up the Federal contribution wLt^ its sc^o>l lunch program* 

The bulk of Jjhnson-O'Mal le\ funds, howrv.-r, go into special projects 
in grades K through 12. Nearly $1.4 million of th'^ total budgpt was al- 
lotted for this purpose with $1,06 million going to 97 sc^oc'ls in 23 
counties in the Muskogee Area. 



A memoranduni under date ^.f Marc*^ 197^' w ic- went cut of the 
Oklahoma State Departmvnt of Edacaticn cv r trr rignatirt of the 
Director of Indian Education contained t^ fi'llowtng guidt^ 1 mvs 

Eligibility . The enrollrotnt mjst consist ^f at least 10' Indian 
pupils (K through 12) cf at least i d^gi.e blood or more or have 
a high concentration of Indian stuOrnts. 

Types of Programs . Teachers t-acher aid-.>. fqjipm-nt, fapplies. 
special education classt^s, remedial proqian^, guidance and counsel- 
ing services, summer programs, kmdergart^^n. and special trans- 
portation needs. In few cases viU supplier and equipment be 
funded. 

Administrator Must Call a Meeting tc scUct a 5 member Indian 
advisory board which must concur m the propcstd program. No 
program will be approved without their written signature on it. 

Pre fere nee . First preference in hiring will be given to qualified 
Indians . 

The Evaluat ion Process 



During the latter part of April, 1972 tht Muikogee Area Office of 
the Bureau of Indian Affairs, following discussions within the BIA, spnt 
to the Indian Education Section of the Okla^cma State Department of 
Education a brief (one page) set of suggestions for evaluating and mon- 
itoring the Johnson-O'Malley projects. This document is shown in its 
entirety on the following page. About a mont- later tne BlA's office in 
Albuquerque which handles the Johnson-O'Mal i.y program forwarded to the 
Muskogee Area Office a similar but more comprthtrns ive questionnaire 
which had been developed thert. This too was forwarded to the State 
Department of Education by the Muskogee Art a Office-- Late in June of 1972 
the Indian Education Section of the State Dtpartm-nt cf Education forwarded 
the shorter and earlier questionnaire to t'.e 97 public schools in 
eastern Oklahoma which had 1971 -72 JOM pr^j-'Cts wif tht- request that they 
be completed. The State Department made oniv v rv minor changes in the 
document proposed by the Muskog<re Area Offic-: . 

The questionnaire developed in Albuquriqu- i:, shewn in t^e appendix. 
It was not given general distribution b/ tne Stat- Dc^partment. Only 
seven schools filled them out and the r-s.lts art too fragmentary to be 
significant. Some conroents on this mstrum^nc are includ*-d in the 
appendix, however. 

It should be made clear that neither tV-^ Muskogee Area Office nor the 
BIA Albuquerque Office made any claims for th^- quality of' their instrun*ents 
They were offered as first stage, exploratorv efforts. That they have 
serious shortcomings is not surprising. Thesc have been compensated for 
to some extent at least by on sitf visits to half dozen representative 
schools by the evaluator. 



JOHNSON-O'MALLEV PROGRAMS - F'l 72 
Guidelines for Kvalua ting/Monitoring 

Name of School ^Dist, No., 

County 

Name and Title of Person Completing Report 

Project Title 

Amount Funded by Indian Education 

Total Number of Students Served 

Number of Indian Students Served 

Summary of Project plan & objectives: 



Budget Breakdown: (including amount for Teachers, Teacher Aides,) 

(amount for equipment & supplies, etc.) 

Test Data (if available): 
Pre & Post 

How well were objectives of project accomplished (poor, fair, good, 
excellent)? 

How does the Project Director and or School Administrator think the 
Evaluation can be improved (Short paragraph) 



Recommendations and Comments: 



By July 25, 1972 v.''ien an evaluation of t'.v rvturni: was t.indor- 
takcn, 76 of the 97 school5= in cast rr Oklapim^n having Jv)M projects 
had responded* This vas a responsi of marl'. 8(» p.rcrnt and, con- 
sidering that scliools were not in s'. t*?;on and t'. 'it nians' sc lool 
administrators wire not on the job was It to be q iite goo;!. A 
total of I9i projects were renorted hv t'n 7^ Kch.^cls r. spondmg. 
On the following page these projects ar- listed b.- tvpc , s'lowing 
the number of each and the total funds allocat.^J ro eacli. 

By far the most popular type of prograiii was t*\at cf teacher aides 
with 66 of the 76 schools so reporting. The ijalaries of teacher aides 
accounted for F.ore than $350 thousand or 43 percent of r'lc total of 
nearly $815 thousand reported as having been allocated for the total of 
191 projects. Judging iram the brief descriptions given under the head- 
ing "sumnary cf project plan and object Ives" , the principle* .'.se of teacher 
aides was the standard one of perf3nning routin-i tasks of record keeping, 
duplicating of materials, etc., in order to free tlv. teaclior for her 
professional job of teaching. There is an occasio'Ml reference to teach- 
er aides actually working with children- Cvcn less frequently was the 
point made that the teacher aide was Indian and bilingual and thus was able 
to smooth the road for some of the Indian stiidonts. Tiiere is no record 
of how many of the teacher aides were Indian; tir information was not 
called for and of course was not given. Presuinabl y most of the teacher 
aides were Indian because of the Indian preference in hiring instruction put 
out by the State Department of Education, 

The second most numerous project was thai of kindergarten. In some 
cases the JOM funds enabled the sc>«do1 to i^tart a kindergarten; in other 
cases they made it possible to hire a tearhier full time rather than half 
time as in the past. Twenty- five of the 76 schools reported that JOM funds 
in the total amount of $68 thousand were used to pay all or part of the 
salary of a kindergarten teach^^r. It should also ht- mad*^ clear that many 
of the teacher aides who have oocn included 'jnder il'.at st^parate h.eading 
were actually assisting the kindergarten tt.acher. Hie n.oped for benefits 
from kindergarten, as stated, were prettv much thoj:." T^hicJ; A.T^rrican ed- 
ucators rely on from early childy^ood ^^duoatv^n - ch.- lecirning of concepts 
and vocabulary, the soc iali /-at ion jf r»i:Mren, ih** niasl< rv of somt simple 
skills, and incre-as'i'd readiness for the first j^rade work. 

Nineteen of the schools used nearly $93 thousand dollars or 11 pc^rcent 
of the total for the salaries of counselors; either hiring counselors they 
had not previously had, or expanding positions from part to full time. 
The most freqviently given expectation from counselors was increased at- 
tention to the individual needs of students in a groat variety of situations. 
In the case of Indian students this woi.ld include familiarizing them with 
certain educational benefits available to them because of their Indian 
ancestry. 



MUSKOGEn ARI:A - iUA 
TYPE AND FUNDING OF 76 JOM PROGRAMS - 1971- 7J 

TYPE OF PROGRAM NUMBER AMOtNl 

Teacher Aides 66 $330,132 

Kindergarten 25 68,262 

Remedial Programs 17 90,726 

Supplies and Equipment 23 31,^15 

Counseling 19 92,746 

Art, Music, etc- U 60,976 

Special Education 5 15,123 

Transporcation 8 7,848 

Tutorial 4 14,086 

Class Size Reduction 6 36,436 

Summer Programs 2 8,353 

Bilingual 1 3,223 

Enrichment 3 34,295 

Reimbursement for 

Indian Meals 1 I, 25b 

Total 191 $814,877 

Total Number of JOM funded schools in tho area 97 

Percentage of funded schools reporting 8Q7, 

Percentage of the total funding sbuwn by types of programs: 

Teacher Aides 

Kindergarten 8+Z 

Remedial Programs lV/„ 



Reraedidl progranis i^^n. rcportt d 1" ^c'ooi^» i^nst inert al' in 
the areas of reading and TiiaLricinatics ' ->.:. ill* t ' . prov)\^-^s cj'isistcd 
of hiring one or more additional tcaclH r ' t \i ^norc t i-^c co- Id de- 
voted to individual students wio wc rt n tirtJtc .n t U' . aciivc'-'tMn 
There was net much suggestion t>at t"- ttpc^ rs ' .r d Mad .^pcci.il qunl 
ifications in remedial teaching 

Eleven projects totalling nearly- S61 tloiiSc>nd were im a.ssortid special 
fields such as music, art, health -c^ducation, art.^ and crafts, etc Three 
projects identified as "enrichment'' rf- cf a soncwhnt si-niljr nature 
One of these in a dormitory school, for v>:anip]e, wab a \)rA< Carugie course 
in public speaking. 

There were only five projects classified as special education. Two 
of these included the services from a nearby ^oilego of a psychologist 
to help several emotionally disturbed children and children wirh severe 
learning disabilities. Four projects were tutorial in nature Most of 
these were in connection with donnitory progranis from v }ict> pupil.s attend 
public schools, with the tutorial services being provided in the dorm- 
itories 

Six of the projects involved hiring extra teacher?? m order to en- 
able a reduction in the size of classes. Here again, tne annovjnced pur- 
pose was to make it possible for teachers to give more individual at- 
tention to pupils. There were two summer projects reported These were 
remedial and recreational in nature. Only one project was ainied speci- 
fically at bilingual teacning 

Only 23 projects involved the purchasing of supplies and equipment 
at a total cost of slightly more than $35 thousand These expenditures 
which included such things as carpeting for kindergarten classrooms and 
equipment for music and art classes seem to be npctssary and moderate. 
Less than $8 thousand dollars were allotted to r ransrortat ion in night 
projects, most of them in kindergarten situationt. wnere Half-dav sessions 
necessitated extra transportation. 

In summing up, the projects included thos« things wnich arc typical 
of efforts in this country to provide compensatory education for eiiildren 
who for one reason or another are ed.icat ional 1 v disadvantaged. In a 
majority of projects the overriding emphasi.*; was on hiring additional 
personnel in order to permit greater attentijn to children on an indivi- 
dual basis. At least these were the stated objective's and there i .s no 
evidence to suggest that these objectives w.. re not adhered ic. Presently 
we shall consider whether the efforts seem to nave bmn successful, but 
first it may be useful to take a look at the particular educational 
problems of Indian children in the Muskogee Area 



The Educaj lonal Dt f icl i and Comp* ns ator ;. 1. ducal ion 

There can he nc doubt th^t t *. Indian . ildrcn of rural eastern 
Oklahoma are educationally d i sadvantagt d . l'^* mart recent f-vidence of 
this is contained in a 1971 report of a four vfar longitudinal study of 
the achievement of Indian nigh school students conducLtd by t'ne South- 
western Cooperative Educational Labtuatrrv at Mb.^qjerqut and entitled 
An Analysis of Academic Achievement of Ind ia n H igh School Students in 
Federal and Public Schools . 

The study found, as "nave manv before it. that Indian children do 
not achieve as well in school, academicallv, as do w'lite students and 
that the farther they go in school the grf-atc-r the disparity between 
their achievement and national nonns. Ire national stadv. Equality of 
Educational Opportunity Tconducted in 1965 by the U.S. Office of Ed- 
ucation and now widely known as "The Coleman Report" after its prin- 
ciple author, showed this to be true not only of Indian students but 
of all other disadvantaged ethnic minorities?, Mexican Americans, 
Negroes^ and Puerto Ricans, as well- The Col^^man Report also found the 
reason for this to lie not so much in the quality of the school programs 
as in the socio-economic conditions of the famili'^s and conmunities 
from which the children came. 

The Southwestern Laboratory studv also rrv^alcd, however, that by 
comparison with Indian students in och<-r parts of the country the eastern 
Oklahoma students were lower in their achievement than those in Alaska and 
the Dakotas and not significantly different from chose in New Mexico and 
Arizona. This finding confirmed an earlier om by Coombs'and his associates 
at the University of Kansas in the 1950* s. The Southwestern Laboratory 
study contained other relevant information aftojt Indian students in the 
Muskogee Area. Only 37 percent of t'^e fath-?rs and 24 percent of the 
mothers were regularly cnnployed. onlv 19 percent of the homes had a 
telephone and only 44 percent of the famili'^s read a daily newspaper 
regularly^ Sixteen percent of the fathers and 20 p^'rc^^nt of the mothers 
were high school graduates, Fortv-fuec percent indicactd that English 
was not the language ordinarilv spokc*n m ih^ir homes and while onlv 12 
percent said that thev did not speak English w-en they started to school, 
in view of the foregoing figure it t»tem> provable that many others did not 
have a very fluent command of English, 

The Southwestern Laboratory study shrdr. no light on thie school achieve- 
ment of non-Indian students in th^ Mj:5k;*gt Ar'M. Fragmentary test scores 
of recent vintage which came to the att^'ntion of t writer seem to indicate 
that they are achieving at or near the national n-)rms. However, comprehen- 
sive data which the writer and his Kansa> l]niv< r^itv coUt agues collected 
some 20 years ago found the white children of rural eastern Oklahoma achiev- 
ing significantly lower than the white children of North Dakota and South 
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Dakota at every grade level. 

In the face of educational a-ficits ^.c*. a? C'i:->^ catlined above, 
school people turn to such d«-vic.- as '~avi b-»-n d-scribt-d in the pre- 
ceding section and which have- cc-nir to t;- known a3 "comp^n3acory" pro- 
grams. Perhaps the most massive application of sjch remedies, nation- 
ally, has been under Title I of th^ EleTnc ntary and Secondary Education 
Act of 1965. The fact that t^'^c-s- re-n<rtii-- bav. not quickly and drama- 
tically equalized the educational atta inTri%.at ;f minoritv grcap ' ^ 
with that of pupils in the g^-n^ral population »^as l^d to disil - 
in many quarters and has led t*" loss of confidt-nce in th<^ ef f icaci.ousness 
of all efforts toward compenratorv education, T^is writ^^r does not be- 
lieve that such a conclusion is warranted. What our fvperience should 
teach us is to search diligentl/ for more eff'ctive programs, to take 
hope from smaller increments of gain and to find ways to better measure 
them, and to redouble our efforts to remove tr.e many societal inequities 
which contribute to educational disadvantage such as inadequate housing 
and discriminatory housing patterns, lack of regular employment of 
parents, and inadequate health car^% to mention cnly a few. 

The Number of Chi Idren Served 

Total Children Served Indian Children Ratio 

Served 

Kindergarten Projects 5>3 273 2 to 1 

All Other Projects 2^,265 8,465 3 to 1 

As shown above the 25 kindergarten projects enrolled a total of 553 
children of whom 273 or about half were Ind.an, All other projects served 
a total of 24,265 pupils of whom 8,465 or slightly more than one-third 
were Indian. It will be understood that these latter figures do not re- 
present that many separate individuals s^ince some pupils v^ere served by 
more than one project. 

V 

Some critics in the past have tak'-n the public ^c^ools to task for 
using Johnson-O'Malley funds for t ne Hen^^fit cf non-lnd ian children. It 
is difficult to see how schools could avoid doing so without creating 
artificial situations which would not be in the best interests of Indian 
children. For example all- Indian grr;uping5 in kindergartens^ remedial 
classes, use of teacher aid^s, etc. wo.ild re-ult in a kind of segregation 
which schools have gone through a long and ardaoas struggle to avoid. 

The School s Evaluate Th ei r Own Pr o jects 

The schools were asked, "How w^ll Wtrt- tVe objectives of the project 
accomplished (poor, fair, good, txct-1 lent ) ?" In most cases the principal 
or superintendent of the school mad*/ ojt the rating Tht^re was a total of 
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158 ratings, some raters gtv.ng a singlf rating to cover all projects. 
The results* 

Excellent 90 



Good 

Fair 

Poor 

Approve- 



•61 



The ratings were impress ivt-ly unanimous in dicir approval. No 
one said that any of the projects bad failed to accomplish their object- 
ives. Unfortunately, the ratings were highly subjective. The question- 
naire did not encourage the raters to elaborate on their ratings or sup- 
port them with more definitive statements and few did The few who did 
are quoted here in full 

School 19 - Teacher Aides, "In out school we have one teacher and or 
adde for each classroom; tnerpfore we ferl the aid'^s have helped in 
many ways--She helps to get the children settled down to begin work. 
She checks papers which gives the teacher mort- time in the class- 
room. She passes out pencils, p^P^^^* colors to the children. 
She takes up lunch money and tak^s it to thf- office. Preparation 
of materials for the classroom and numerous ether non-professional 
d "-fes are assigned to the teacher aid*^ in our school. We think 
Li.^u teacher aides are just great and so do tht pupilSc" 

School 19 - Kindergarten teacher. "Withoit the Johnson-O'Malley 
funds we would not be able to hire a kindergarten teacher. A 
classroom with wall-tD-wall carpet was built for the kindergarten 
It has been equipped with early childhood education needs as our 
foremost goal. The table and chairs are scaled down to a five year 
old size. Our class siz? of 10 or 12 is anideal situation that has 
helped us to meet the individual differences. With this number we 
have been able to have a program of activitv of first hand experi- 
ences, of learning by doing. Funds to purchase the necessary equip- 
ment and supplies for our special needs came from tht JOM program. 
We feel each child has benefited from this project in his individual 
way/' 

School 58 - Counseling and tutoring. "ExcelUnt!!! The Indian drop- 
out has been eliminated. Thev feel important and wanted and have im 
proved academically^ The drop-out ratf among Indians has been re- 
duced 907o." 

School 31 - Music Appreciation. "Th»^ real benefits of this program 
will show up this coming year in improvements in tne band of the 
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school and the number of Indian pupils in the band. Already we 
have an obvious interest m the littU band." 

School 10 - Kindergarten tianspor tat ion- "All 26 children were 
transported and the attendance was exc-llent." 

School 2 - Enrichment program. "Each class added to the knowledge 
and satisfaction of each student participant to an extent that we 
saw an appreciable improvement xn their desire to succeed." 

School 2 - Dale Carnegie Course, "Most cf the students expressed 
themselves at the final session as having gained confidence in their 
ability to speak before others. They specifically recounted that they 
had been able to give oral book reports and in some instances they 
had improved their grades at school," 

School 2 - Remedial reading, "Most of the children showed considerable 
improvement and were much more relaxed in the learning situations." 



The Use of Test Data 



The questionnaire contained the item - Test Data (if available): 
Pre 6c Post. The responses rnake an interesting hodge podge which may 
be summarized as follows: 

Not available or not applicable 117 

Availability indicated but data not shown 29 

Some test data shown- • 12 

It seems clear that in most schools test data are simply not available. 
There is some indication that some schools which say they have test data 
are not sure what to do with it« This statement is typical of these: 

School 34 - "All of our students are testfd and this information 
is always available to your department." 

Several schools made such general statements as to be almost mean- 
ingless. For example: 

School 20 - Teacher aide. "Comparing of pre and post test scores 

shows considerable gain." 

Several schools explained that they give a post test but have no 
pre test to compare it with. They were usually apologetic about this 
and resolved to give a pre test in the future. 
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One rather breeev comment wa- 



School 44 - Tutorial project "No t6*st5- 
was great . " 



'\st .ic"ii.»\.V'Tnent - it 



A number of reports w^rc Tor. -pecific it* not alwavs entirely con- 
vincing : 

School 24 - Special mat-^, "T'lc siaa^ni'= gain^^d i roTn one vear 
progress to as ^igh a^ -4 voars fnn last year's 
achievem.^nt scores . " 



School 41 - Reduction in class si^t and special attention m reading. 

"Test results s-^ow that 81/ of t"e students involved made 
greater tnan 1^^ years of progr-^ss in their average class 
achievement." 



School 56 - Remedial and Special education. "All students showed a 
gain of 1 4 for the year, wit>> most of tre improvement 
showing up in reading and math." 



School 57 Elementary teacher aides, 
grade advance," 



"Eacl child averaged 1.2 



School 58 - Counseling and tutoring- "Majoritv' (90)7. of Jr, High 
students above the national norms for the standardized 
test." 



School 31 - "We have taktu the average percentile scores for all 

children, t'nen we ^'ave averag^^^.d thosi* Indian children from 
Jones Academy who have bei n her? two y-^-ars or more and 
find that there is no difference in the averages. Those 
children who nave been recently* brought to the Academy are 
a little below averag^j.. " 



School 35 - had the following general comment to make. "We could 

evaluate re.s.il ts of stud^n t ach ievemc nt through test ing, 
but it wo'jld be veiv difficult to determine how much 
progress is due to Johnson- O'Mal Lev assij^tance even 
though w»* know it Ips th- «tudt~ nts . " 

We must agree with thr^ above. Standardized surv'^^y type achieve- 
ment tests are not designed to do fine, analytical type measurement- We 
believe that reading readiness tests would be useful and that closely con- 
trolled pre and post tests might fairl/ dependably measure the results of 
a well planned remedial project in reading or mathematics. But it seems 
highly unlikely that standardized tests can serve as valid measures of the 
benefits derived from teacher aides, counseling, or supplies and equipment 
where a great deal of the JGM money is going. We would agree that con- 
sistently higher achievement test scores noted over a considerable period 
of time might be considered as evidence that the totality of compensatory 
programs are getting results- 
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Suggest i JDS by Rc spondc nt6 t c*t t - Itnptc v^niu^nt of E-:a luac ion 

Tbe questionnaire askcrd How does the Project Dirt^ctor and/or 
School Administratcr think the Evaluation can br improved. (S'-^crt 
paragraph) Th^ responses can cattgorlz-^d a? fellows: 

Adequate: as it is • 36 

No suggestion 34 

« 

Question ob viO'J sly in isund-r stood 46 

Suggestion offered --45 

Those who designed the evaluative instrunient us>?d considered it 
only a mininial beginning. Its brevity, subj^ctiviLv , and serious om- 
issions which will be commented on later mark it as inadequate. The fact 
that a total of 70 responses ^'ither considered it adequate or had no sug- 
gestions for its improvement suggest that those respondents were relieved 
*• at it was no more demanding. Another 46 respons--s seem to hav^ resulted 
from a misinterpretation of the qu^'^stion, Tl.ev seem to have assumed that 
the question asked how the projects might be improved, not the procedures 
used to evaluate them. Upon reflection it seems to us that the question 
is susceptible to that misinterpretation. 

However, 45 suggestions for improvement of the evaluative process 
were offered and a number of them are valuabl*^ on^.s. Several simply call 
for more comprehensive test data, a subject which was discussed in the pre 
ceding section, although one or two did suggest that testing and test in- 
terpretation should ue done by proff^ssionais with special training in the 
field. 

A number of suggestions called for evaluation earlier in the school 
year, indicating especially dissatisfaction with an evaluation which is de 
layed until most school personnel have dispersed for tbe rummtr recess. 
The suggestion strikes us as most valid. 

Most of the suggestions, however, bor? upon thn point of broad'^ning 
the evaluation to involve more, lnde^"d all, persons active in the pro* 
jects and to do so on a continuing bas;s throughout the duration of the 
project. For example. 

School 53 - Teacher aides. "Tht work of an aide is definitely 

subjective in the area of evaluation. It would seem 
to me that joint conferences between teacher aides, 
individual teachers, and the building principal 
would be valuable in determining additional needs of 
Indian students and thus point to additional areas 
where the aide could r^-adily contribute. Parent 
feedback obtained in md i vidua 1 conferences should 
also point out additiv>nal areas wh*^ re th"' school 
staff could assist ind 1 vidua 1 students , 



School 53 - Counselor, *'0n a long term basis follow up studies 
conducted by the school staff should be valuable in 
determining if the counselor is actually reaching 
students dtiring counseling sessions while the 
students are in school. Follow up studies should 
also be useful in curriculum evaluation and pos- 
sible revision/' 



School 53 - Equipment and supplies, "We feel the present pro- 
gram of using a parent advisory group to assist the 
administrator in planning the program to be instal- 
led and then using the same group to evaluate at the 
cone lusion is adequate . '* 



Other suggestions, while less articulate and comprehensive, are 
along the same lines: 



School 66 - Counseling and Arts and Crafts. "Total involvement of 
the State Department of Education, Indian Education 
Division staff. Field Coordinators, school adminis- 
trators, certified and non-certified people who are 
involved in the proj ect . " 

School 34 - Teacher aides, "By individual evaluation by the 
Indian Department, the aides, and the school of- 
ficials of the district." 

School 45 - Kindergarten teacher, aide, and supplies. "By 
visitation by parents and committee evaluation, 
suggestion, and group counseling." 

School 41 - Reduction in class size for special reading help. 
"School visitation of all concerned." 



School 1 - Teacher aide. "I believe the evaluation could be 

improved by having each teacher make a short comment 
on the help the teacher aide gives to them, or what 
it means to them," 



School 16 - Teacher aides, "By a close observation by the 
school administration in all the activities 
involved . " 

School 33 - Teacher aides. "School visitation." 

School 56 - Teacher aides. "Morr involvement of the area co- 
ordinators in the evaluation process . " 

School 57 - Elementary teacher aides. "We weed a little more 
parent participation . " 
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School 58 - "On site evaluation - to see the program in action," 



School 72 - Teacher aides "The evaluation might ask for a 

statement from the aides and get their opinions as 
well as their reactions to what they do in their jobs." 

School 64 - Kindergarten. "On the spot evaluation by field 
representatives from State Department of Ed- 
ucation." 

Sch ol 60 - Teacher aide. "By hfving the teacher help the 
administrator." 



School 70 " Indian counselor. "The Indian advisory council feels 
that our counselor is doing a very good job." 



OLher comments were: 



School 23 - Teacher aides (recreation) and Counseling. "Send 

out evaluation instruments at an earlier date. Also, 
develop instruments with which to evaluate programs 
objectively according to their specific purposes." Also, 
"More objective instrument - supplied at an earlier date". 

School 49 - Kindergarten. "The past year we worked in conjunction 
with a bilingual program under Title III who did the 
evaluation. Next year we will call on the Guidance 
Counselor to do the evaluation." 



The difficulty of it all is expressed by: 

School 65 - Counseling. "Evaluation of this project is difficult. 

Only time will tell the overall effect. From personal 
observation it appears to be effective." 

School 56 - Remedial and Special education. "None at the moment. 
Have to have a longer time to think on that." 

We believe that the suggestions given above are constructiv^e and 
in the right direction. The benefits resulting from compensatory pro- 
jects are hard to quantify with precise measuring instruments. The best 
answer seems to be the cooperative involvement of all those persons who 
are in a position to contribute to the evaluation* It would necessitate 
too the pre-planning of evaluative criteria and a fairly careful de- 
scription of results, using anecdotal material where appropriate. 



Rccotnmendations and Coinments from the Schools 



Finally the schools were asked for their recommendations and com- 
ments. The responses are summarized below: 

None 32 

Continuation of the program 28 

Increase in the scope and/or funding of the program 50 

Expressed approval of the program 73 

Specific suggestions 26 

While a number of the respondents had no recommendations or 
comments to offer the great majority gave overwhelming approval to the 
program. Twenty-eight specifically called for a continuation of the 
projects and 50 others went beyond that and asked that the program be 
increased in scope, usually with increased funding. It would be easy 
enough to ascribe these requests to "empire building" and that may have 
been true in some cases. This evaluator, however, is convinced that the 
reactions in the main represent a genuine oelief in the merit of the pro- 
jects and a conviction that Indian pupils are benefitting from them. A 
number of relevant comments, chosen somewhat at random, are given below: 

School 6 - Teacher aides. "These are bilingual aides. They have 
been very helpful to the teacher and especially helpful 
to the Cherokee children - they translate in Cherokee and 
English," 

Teacher aides. "This program provides an excellent opportunity 
for Indian people to participate in the activities of the 
school. It offers help in language and cultural barriers 
and provides an income for people who really try." 

Elementary teacher aides. "This has been a very good pro- 
gram. Our Indian Education Committee has really helped 
the community attitude," 

Kindergarten, "Well satisfied with program and has been a 
help to the students of our school. Also, improved school 
and community relations since many people have taken an 
interest in the program." 



School 72 - 



School 57 - 



School 4 - 
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School 33 - Counseling. "We find a greater percent of Indian 
students are going on to higher education." 



School 8 - Counselor. "With the aid of this program we were able 

to direct all Senior students who qualified and desired a 
chance to obtain a college scholarship. I feelthat this 
program was very beneficial to the students and school/* 

School 51 - Remedial reading and mathematics. "The remedial pro- 
gram (should be) continued and Indian aides provided 
to help students relate to their culture." 

School 10 - Educational aides. "Many of the parents of the 
children were very pleased at the progress the 
children made and they feel they are well pre- 
pared for the first grade/' 

Several comments stressed the need for inservice training of per- 
onnel : 

School 23 - Counseling. "Inservice training for teachers and coun- 
selors of Indian students to develop awareness of their 
particular needs and to develop skills in helping these 
students in fulfilling these needs." 

School 46 - Remedial reading and mathematics, "We would recommend 
some trained personnel come for a short inservice pro- 
gram to help in training our local aides to be of greater 
help in our programs. Currently we are getting assistance 
from a specialist from the Learning Disability Center and 
it has worked beautifully." 

School 46 - Teacher aides. "Continue to provide inservice training 
for our Indian aides. Strongly recommend pay increase 
for our aides." 

School 56 - Teacher aides. "Strongly recommend contiiuation and broad- 
ening of program. Also continuation of yearly workshops 
to upgrade the quality of aides." 

School 64 - Teacher aides, "All aides should be required to attend 
workshops prior to working. State Department should re- 
quire that aides have high school diploma or the equiv- 
alent." 

A number of suggestions recommended changes in the program: 

School 73 - Teacher aides. "Recommend that teacher aides be used 
more to help the individual student. Our teacher aide 
program was very successful in allowing the teacher 
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more time to spend with each student." 

School 2 - Enrichment program. "The School Administrator thinks 
that we need to have fewer arca'j of study and con- 
centrate on arts and crafts, music, and counseling 
students in the academic program in the public schools/* 

Teacher aides (recreation). "Provide for schools to be 
notified at a much earlier date as to whether or not 
their particular proposal has been approved. The hir- 
ing of personnel in July or August is extremely dif- 
ficult." 

Teacher aides. "I feel this program can be improved by 
making it available to all schools - by lowering the 
percent of Indians required at a school site in order 
to be eligible/' 

Counselor, "We feel that the counseling program was 
very good for a beginning program. However, we feel 
that to reach maximum students we need the services of 
a full time guidance counselor who has no other duties 
or responsibilities/' 

Teacher aide. '*More attention and money needs to be put 
into developing native skills in high school and junior 
high for Indian students- This would include commercial 
art , commercial crafts , and c^ccupational ski 1 Is leading 
to jobs." 

There is no doubt that some of the above suggestions have merit- 
There is, however, a disappointing lack of new ideas. Strange as it 
might seem to some, Indian culture and Indian languages are still very 
much alive in eastern Oklahoma after 140 years. Their prevalence has 
been modified by association with the dominant culture it is true and 
yet the strength of Indian cjlture, including language, is significant 
enough that school planners should be taking it into account. In all 
the responses there was only one reference to bilingual instruction 
although interest in this field has reached a high point nationally. 
Considering the central and colorful role of the Indian in the his- 
tory of Oklahoma, it is surprising that no projects were centered 
around Indian history, biography, and art. Non-Indian children, quite 
as much as Indian children, in eastern Oklahoma need to be aware of 
these • 

There were one or two projects involving the use of expert help 
from the colleges and universities in specialised fields such as learn- 
ing disabilities and the emotionally disturbed. It would be encouraging 
to see more. 



School 23 - 



School 34 - 



School 53 - 



School 63 - 
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/i?ld Visitation 



During the week beginning July 30, 1972, this evaluator, 
accompanied by an education specialist from the Muskogee Area Office, 
visited six schools in three counties in eastern Oklahoma* Three 
different JOM coordinators of the Oklahoma State Department of Ed- 
ucation accompanied us. At each of the six schools we visited with 
the administrative head about the Johnson-O'Malley funded projects. 
At three of the schools we were also able to confer with one or more 
members of the Community Indian Education Committee • Also during the 
week a conference was held with the Director of the Indian Education 
Section of the State Department of Education in Oklahoma City. Each 
of these visits was cordial and informative. Some facts which had 
not been made clear in the questionnaires e:ncrged in the conferences* 
For example, it was explained that in a good number of cases the 
kindergarten instructional aide may conduct what amounts to a day care 
center for the 5 year olds in the afternoon after their half day in the 
kindergarten in the forenoon, or vice versa. The children are given 
lunch at the school and a snack and rest period. This enables them to 
ride the same school buses as the older children and eliminates the need 
for extra transportation. Other schools opt for providing the extra 
bus trip* 

It also became clear that the teacher aide payroll is a not insignif* 
icant economic factor among the Indian people of eastern Oklahoma, totalin 
for the 76 schools reporting at least 100 jobs and an annual payroll of 
$350 thousand. 

The greatest benefit derived from the school visits came, however, 
from insights gained in areas not touched by the questionnaire distributed 
to and returned by the 76 schools* We will discuss these quite candidly 
in the following sections for we believe that these hold the key to any 
real breakthroughs in improving education for Indian children* 

THE UNASKED QUESTIONS 

"k •/? '.VVf Vf 'k if k 'A- Vc k */? if */? •/? 'V ick "k 'k "k it i< if ic ic ic 

Parental Costs 

The question of parental costs as a part of the Johnson-O'Malley 
program was not raised in the questionnaire developed by the BIA 
Muskogee Area Office and distributed by the Oklahoma State Department of 
Education. It was included in the questionnaire developed by the BIA 
Division of Educational Assistance in Albuquerque, a copy of which is in- 
cluded in the appendix. Parental costs are such costs as student act- 
ivity tickets, school yearbooks, gym fees, etc. They have not been pro- 
vided for Indian students under the JOM program in Oklahoma, although 



-20- 



tbcre has been discussion about tlii^ bctw(M^n the- lUA and the State 
Department and they may be inclucied at s:>^o future time Parental 
costs are provided for in tht JOM contracts in ?ome states Ironically, 
several of the 7 schools returning the Albuquerque quesionnaire stated 
that the parental cost program had had beneficial effects with their stud- 
ents, a clear indication that the question was not understood. 



Indian Control of Johnson-O^Mal ley Programs 



Indian control of the programs which educate Indian children is current- 
Iv the hottest issue in the entire field of Indian education. One aspect of 
this IS a drive to transfer operational control of schools now run by the 
Bureau of Indian Affairs to vario'is tribal entities. As noted at the begin- 
ning of this report, the United States Senate and certain civil rights groups 
have vigorously advocated the control of Johnson-O'Mal ley funds by Indian 
people. The questionnaire which has served as the basis for this report 
makes no reference to the issue of Indian control or the involvement of 
the Indian communities in the use of Johnson-O'Malley funds. No analysis 
of the situation could be complete, however, without going into it. 

It >^as been suggested in Washington that Johnson-O'Malley funds for 
Oklahoma be turned over by the BIA to Indian tribes which would then neg- 
otiate their own contract with the Oklahoma State Department of Education 
for the public school education of Indian children Under date of March 24, 
1972 the heads of the Five Civilized Tribes passed a resolution urging con- 
tinuation of the present Johnson-O'Malley arrangement but saying that if a 
decision was made to develop a contract between the BIA and the tribes there 
should be a single contract with the Five Tribes rather than individual 
contracts with the separate tribes. 

As noted earlier, the State Department of Education has notified 
public school administrators that they must call a meeting to select a 
3 member Indian committee and that no program will be approved without 
their signed concurrence. The rationale for this requirement, as explained 
earlier in this report, is the uniqviely Indian character of JOM funds. It 
is a sensitive area which requires sensitive handling. 

We discussed the Comntunity Indian Education Ccrnmittees with the 
school administrators, the coordinators, and several mambers of the com- 
mittees themselvas. We encountered a wide range of attitudes. No ad- 
ministrator openly opposed them. One was enthusiastically in favor of 
them and had ideas for their effective use- The attitude of two others 
was positive if not particularly inspired. Two more were noncommittal 
and the sixth expressed some apprehension about problems that might be 
encountered. Of the coordinators, one saw great potential for good in the 
functioning of the committees, one spoke of the dangers of the committee 
intruding upon the rightful authority of the school administrator and elec- 
ted school board, and the third was rather guarded about the matter. The 
committee members themselves did not seem to have strong feelings about 
their role although one of them provided this evaluator with important in- 
sights about the attitude of Indian people toward the schools. 
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All of the persons interviewed, adtnini stratcrs , coordinators, and 
Indian conmitcec members, were in unanimous agreement that the 
Jo-^nscn-O'Malley projects had been very mucf wort'' while. 

About half of the school administ raters reported that their efforts 
to arrange for the election of Indian committees had not been successful 
because of the non-attendance of Indian parents at meetings called for that 
purpose; as a result they had appointed the committees. One school that 
had managed to elect a committee had fojnd it necessary to call a second 
meeting before the required number of Indian parents turned out. One 
school had a committee including the ncn- Indian husband of an Indian 
mother of school children and also a non- Indian elementary school prin- 
cipal who. It was explained, had been asked bv the Indian parents to 
serve on their behalf. 

The situation is fraught with opportunity for misunderstanding on 
both sides. The Indian committees as tnev are now set up are more than 
advisory; they have veto power over program proposals. School admin- 
istrators are likely to see this as an invasion of their professional 
function and elected school boards may see it as an invasion of their 
control of school funds. We were told that to complicate the situation 
the U.S. Office of Education is now requiring that a committee of persons 
in the district who are below the poverty line must approve the use of 
Title 1 funds of the Elementary and Secondary Education Act. Indian 
parents, on the other hand, are inclined to wonder why they are suddenly 
being importuned to pass judgment on the use of JOM money and to suggest 
projects for its use. So far there have been only one or two cases of 
actual confrontation between Indian committees and school administrations 
in the Muskogee Area but the ingredients for more are certainly present 
if either side becomes intransigent. It has been pointed out that one 
possible result of such an impasse would be the failure to have any pro- 
gram at all . 



Indian Involvement or Indian Control 



It seems to this evaluator that b^forf great things can be expected 
from Indian control of JOt\ funds there mast be an Intensive effort to 
involve Indian patrons in all aspects cf the life of the school. This has 
not y^:t come about; typically Indians fe^l alienated from the school pro- 
gram. They may attend athletic contests or other types of school enter- 
tainment but infrequently do they present themselves as candidates for the 
school board, too few of them vote in scnool elections, too seldom do they 
approach teachers or counselors or administrators with questions about 
their children and what the school is trying to do for them. And the 
schools, perhaps accustomed to more aggressive white parents, or not know- 
ing how to draw Indian parents into active involvement, have let it go at 
that. While we may properly f.njoin Indian parents to take a more active 
part in school affairs, this evaluator is convinced that the schools are 
going to have to do more than that. They are going to have to carry on an 
active campaign of involving Indian parents. They must do it for the best 
of all possible reasons - Indian children are not going to do very well in 
school until they do* 
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And so while Indian control of funds m\ Sieir. crucial to those to 
wpom the exorcise of power is of primary inportance, to us the involve- 
ment of Indian parents in many other wavs seems to be a necessary pre- 
requisite. Once that is accomplished Indian control of funds will fol- 
low on a much firmer basis. We dc not believe that it is fair or accurate 
to say, as some do, that Indian parents are not interested in the educa- 
tion of their children. They are diffident, shy, unsure. In our view the 
schools and tribal leaders must play a more active role in changing this. 



The Role of the Coordinators 



In this effort we see the coordinators employed by the State De- 
partment as key persons. They now perform certain liaison functions 
between the State Department of Education and the schools on the one 
hand and between the schools and Indian families and individuals on 
the other. These functions as they now exist, however, appear to be 
of a rather routine kind, consisting largely of conveying information 
from one party to another and taking care of some record keeping. We 
are suggesting that the concept of the coordinators role be greatly 
expanded to something like that of an "ombudsman" who would examine 
causes of tension between the school and the Indian families, but more 
orecisely that of a catalytic agent who would interpret the goals of the 
school and the needs and problems of Indian families to each other. Most 
important of all, the coordinator would draw the school and the Indian 
parents together so that they would communicate with each other. 

It goes without saying that such a role would be a demanding one and 
would call for unusual talents and abilities. The coordinator would need 
to have the trust and confidence of both the Indian community and the 
school establishment. He (or she) would need to have enough professional 
competence to make an input into educational planning but would need even 
more to understand Indian attitudes and aspirations and be sympathetic 
toward them. It is hoped that the State of Oklahoma would not set such 
rigid qualification standards for these jobs as to exclude persons having 
the rare qualifications called for. 

It is recognized that simultaneously with the efforts of the coordin- 
ators, members of the Community Indian Education Committees and resourceful 
Indian teacher aides can make most significant contributions toward drawing 
the school and Indian families together in a more meaningful relationship. 

The Relationship Between Indian Involvement and 
Removing the Educational Deficit 

Those who have contended most insistently for Indian control of 
JohnSon-O'Malley funds have almost always, at the same time, pointed to 
the Indian educational deficit as proof of the failure of the school. 
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4 



The effect has been to suggest that control alone will increase the 
learning of children and persuade them to stay in school to the com- 
pletion of their school course. There is little ground for such a 
short term basis and it is misleading to suggest that there is, Indian 
people nf^ed to have a greater voice in the education of their children 
for humane and ethical and democratic reasons - for the sake of human 
dignity and pride. Eventually - in the long term - this will pay off in 
greater educational attainment. 



Planning and Priorities 



Finally, in our interview with the Director of Indian Education he 
expressed a view that is of central importance. That is that the schools 
need to be planning with Community Indian Education Committees a great 
variety of programs - more programs than it will ever be possible to fund 
in a given year - and then establish priorities among them. In that way 
ideas can be given free rein. 



ERIC 
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Sunmiary 



Jo-nson-0*Malley funds are id*- nti f lable as "Indian money" in a 
way not trje of any other Federal aid to public schools. 

As a result of the- uniquely Indian character of Johnson-O'Mal ley 
appropriations, the Bureau of Indian Affairs and the public schools 
are being pressed by civil rights groups and the United States Congress 
to account for their use to the Congress and to the Indian people. 

The Johnson-O'Malley program in Oklahoma in 1971-2 was based on a 
contract with tne Bureau of Indian Affairs in the amount of $1.9 million. 
The bulk of this money, $1.4 million, went into special pro jects, $1 .06 
million to 97 schools in 23 counties in eastern Oklahoma • Guidelines 
issued by the Oklahoma State Department of Education include requirements 
that preference in hiring be given to qualified Indians and that Community 
Indian Education Committees, which must concur in the proposed program, 
be elected. 

In the spring of 1972 the Bureau of Indian Affairs began plans for an 
evaluation of Johnson-O'Malley programs. The Muskogee Area Office of the 
BIA developed a short nuestionnaire which the Oklahoma State Department of 
Education sent on to public schools in eastern Oklahoma with only minor 
changes, A somewhat more comprehensive questionnaire, developed by the 
BIA's Division of Educational Assistance in Albuquerque, vas not used, 
is shown in the Appendix with comments. 



It 



Eighty percent or 76 of the 97 schools in eastern Oklahoma having 
programs, reported a total of 191 projects. Of these, 66 were for 
teacher aides, 25 were kindergartens, 19 were counseling services, and 
17 were remedial programs. Other projects included art and music, 
tutorial services, class size reduction, and special -rams. Most of 
these projects would be classed as "comp- - * ure , stressing 

greater individual attention to pupils, 

Indian pupils in eastern Oklahoma, ac o r.ng to recent studies, have 
a school achievement deficit as severe as ctiat of any Indian pupils in the 
country. They also suffer from severe socio-economic disadvantages. 

In all, nearly 25 thousand children were served by the projects, 
nearly 9 thousand of them Indian. The ratio of Indian students to the 
total was one of every two in kindergarten and one of every three in all 
other projects. The evaluator agrees with school officials that Indian 
pupils cannot and should not be segregated from other pupils in order to 
exclude non-Indian pupils from the benefits of Johnson-O'Malley projects. 

Th? schools almost unanimously rated the projects successful in attain- 
ing their objectives. Of 158 ratings all but 7 were either "excellent'' or 
"good"- Wliile the ratings were highly subjective, there is no reason to 
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q'M^sc ion tvvi r si nci^ri ty 

T:^e returns showed an almost total lack of standardiz ?d test data 
us abl( for e\'aluation. However, ordlndry survey tvp'^ acl ievemenc test 
data rave limited iscfulness in evaluacing PMc^ projects as teacher aides 
or counseling, even if available, 

l-Zl-en asked for suggestions for improving the evaluation more than 40 
percent cf the respondents expressed themselves as considering it adequate 
or having no suggv^stions . Another 29 percent, perhaps because of its ambig 
uity, misinterpreted the question. Btjt another 29 percent did make suggest 
ions, most of them, in the opinion of t^e evalaator, in the right direction 
These included suggestions that evaluation begin earlier in the school year 
and the cooperative involvement of all persons in a position to contribute 
tc the evaluation. Included would the pre-planning of evaluative crit- 
f-ria, and a careful description of resiilts, including anecdotal material 
where appropriate. 

When asked for their recommendations and comments, the schools over- 
whelmingly gav3 their approval to the projects, called for their continua- 
tion, and frequently asked for an increase' in the scope and funding of the 
projects. A belief in the program beyond mere "empire building" comes 
through in the response The trend, however, was for "more of the same" 
and there was a disappointing dearth of new ideas. There seemed to be a 
notable lack of awareness of the bilingual problems of many Indian child- 
ren in eastern Oklahoma and no suggestions for projects centered around 
Indian history, biography, and art. It would also he encouraging to see 
more interest m the use of expert help from the colleges and universi- 
tii?s in the specialized fields of severe learning disabilities, emotional 
disturbance, and mental retardation. 

Thp evaluator made personal visits to six schools in three counties, 
conferring with school officials, three of the state coordinators, and 
members of three Community Indian Education Comanittees. 

A number of concerns not broached bv the evaluative questionnaire 
are of crucial importance. One of these, the issue of Indian control of 
Johnson-O'Malley funds, was discussed with schr*ol administrators, coordin- 
ators, and Indian committee members Their reactions were interestingly 
mixed. One administrator and one coordinator were enthusiastically in 
favor of them and had Id^as for their f ff^rtiv^' use. Two administrators 
had positive attitudes. Two admin - :-L rators and o.ic c^rrdinator v^fi" rc non- 
committal, and onf^ administrator and one coordinator expressed some ap- 
prehension about problems that mig^*t be encountered. The committee mem- 
bers did not seem to have strong feelings about their role. 

Tlie Indian Education Committees ar(^ more than advisory; they are 
vested with veto powers over proposed projects, Sc^'ocl administrators 
and elected school boards are likely to see this as a threat to their 
professional function and to their general control of school funds. 
Indian committee members, on the other hand, may wonder what lies be- 
hind their sudden elevation to d^^cis ion^making status. The present 
situation could lead to unnecessary conflict and inaction. One re- 
sult of such an impasse would be tl«e failure tc have any program at all* 
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This evaluator suggests that more important at this point than 
Indian power and control is the active Involvement of Indian parents 
in the life of the school on a broader front. At present this does not 
exist. Indian parents tend to be alienated from the schools that serve 
their children. They do not understand them as well as they must. On 
the other hand the schools do not appear to be making a sufficient effort 
to understand the attitudes and aspirations of Indian parents, l^at they 
construe as disinterest in the education of their children is more often 
diffidence, shyness, and uncertainty. The evaluator believes that the 
schools must take the initiative in drawing Indian parents into part- 
icipatory roles in the school. Once this happens, Indian decision- 
making will follow naturally. 

The evaluator sees the coordinators employed by the State Depart- 
ment of Education as being key persons in this effort. Now performing 
rather routine liaison and record keeping functions, they should serve 
as catalytic agents between the school and the Indian community. The 
role would be demanding and would call for unusual talents and abilities. 
Indian Education Committee members and Indian teacher aides could also 
play most significant roles in drawing the school and the Indian commun- 
ity together. 

Indian involvement will not wipe out the educational deficit of 
Indian pupils overnight but in the long run it will pay off in greater 
educational a t tainmen t . 
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APPENDIX 



MUSKOGEE AREA 



JOHNSON-O'KiALLEY PROGRAM 



PROGRAM EVALUATION 



SCHOOL AND PROGRAM DISTRICT 

1. AHLOSO D-26 
Remedial reac ing 

Teacher aides 

2 . ARDMORE 19 
Carter Seminary enrichment 

program 
Dale Carnegie course 
Remedial reading 

3. BATTiEST 1-71 
Teacher aides 

Supplies & equipment 
Counselor 

4. BEARDEN D-29 
Kindergarten 

5 . BELFONTE 50 
Special reading teacher 

Teacher aides 

6. BELL 33 
Kindergarten 

Teacher aides 
Art & music 

Health aide & miscellaneous 
Supplies & equipment 

7. BENNINGTON T-40 
Teicher aides 

Counselor 

8. BOWLEGS 1-3 
Counselor 

Teacher (reduction of class size) 

9. BRIGGS 44 
Kindergarten 

Teacher aides 

10. BROKEN BOW 74 
Teacher aides 

Kindergarten transportation 



COUNTY 
Pontotoc 

Carter 



McCurtain 



Okfuskee 



Sequoyah 



Adair 



Bryan 



Seminole 



Cherokee 



McCurtain 



ERIC 



SCHOOL AND PROGRAM 



DISTRICT 



COUNTY 



11. BROIIDE 
Teacher aide 

12. COLCORD 
Teacher aides 

13 . CASTLE 

Teacher aide (kindergarten) 
Reme dial teacher 

14. CAVE SPRINGS 
Counselor 
Kindergarten 
Teacher aides 
Supplies 

15 . CHECOTAH 

Teacher aides (kindergarten) 

16. CHRISTIE 
Kindergarten 
Speech therapist 
Teacher aides 
Supplies 

17. COALGATE 
Music director 
Music aide 

18. COTTONWOOD 
Teacher 
Teacher aide 

19. DAHLONEGAH 
Kindergarten 

Teacher aides 
Supplies 

Transportatic 1 (kindergarten) 

20. DENISON 
Teacher aide 

21. DEWAR 
Kindergarten 
Teacher aides 
Supplies 6c equipment 

22. DICKSON 
Teacher aides 



50 Johnston 

4 Delaware 

19 Okfuskee 

1-30 Adair 

1-19 Mcintosh 

13 Adair 

1-1 Coal 

D-4 Coal 

29 Adair 

37 McCurtain 

1-8 Oktnulgee 

77 Carter 



SCHOOL 6. PROGRAM 



DISTRICT 



COUNTY 



ERiC 



23. EUKAULA 

Teacher aides (recreation) 

Counsel ing 

Tutorial 

Transportation (dormitory students) 



I-l 



Mcintosh 



24. FILLMORE 

Remedial math (teacher) 
Remedial math (teacher aide) 



34 



Johnston 



25 . GLOVER 

Teacher aide 



23 



McCurtaln 



26. GOODLAND 

Teacher aides 



13 



Choctaw 



27. GRAHAM 

Kindergarten (teacher & supplies) 
Teacher aides 
Remedial reading 
Counseling 



37 



Okfuskee 



28. GRAND VIEW 

Kindergarten (teacher & supplies) 
Teacher aides 



34 



Cherokee 



29. GREASY 

Art & music (teacher salary) 
Teacher aides 

Kindergarten (teacher salary) 



32 



Adair 



30. HANNA 

Summer program (teacher) 
Summer program (aide) 
Aide (regular school term) 



1-64 



Mcintosh 



31. HARTSHORNE 

Art (teacher 6t supplies) 
Music appreciation 
Counsel ing 
Tutorial 



Pittsburg 



32. HOLLY CREEK 
Teacher aide 



72 



McCurtain 



33. HULBERT 

Teacher aides 
Kindergarten (teacher) 
Counsel ing 



1-16 



Cherokee 
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SCHOOL 6. PROGRAM 

34. IDABEL INDEPENDENT 
Teacher aides 

Transportation (kindergarten) 

35 . JAY 

Teacher (salary) 
Teacher aide 
Counselor 

36. KANSAS 
Teacher aides 

Tutorial fees (very limited) 
ACT fees (college entrance) 
Counseling 

Kindergarten (teacher) 

37. KENWOOD 

Kindergarten (teacher salary) 
Teacher aide (kindergarten) 
Remedial reading(teacher salary) 

38. LATTA 
Teacher aides 

39. LEACH 
Teacher aides 

Kindergarten (teacher & supplies) 

40. LIBERTY 

Remedial reading (teacher salary) 



41, 



42. 



43, 



44. 



LOST CITY 

Kindergarten (teacher salary & 

supplies) 
Class size reduction 
Remedial reading 
Teacher aides 

LUKFALA 
Teacher aide 
Transportation 

MARBLE CITY 
Teacher aides 



DISTRICT 
5 

I-l 



30 



1-24 



14 



14 



17 



35 



22 



MARYETTA 
Teacher aides 
Tutorial (music) 

Special education (emotionally disturbed 

6t learning disabilities) 



COUNTY 
McCurtain 

Delaware 



Delaware 



Pontotoc 



Delaware 



Tulsa 



Cherokee 



McCurtain 



Sequoyah 



Adair 



ERIC 
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SCHOOL & PROGRAM 



DISTRICT 



COUNTY 



45, MASON 

Kindergarten (teacher) 

Kindergarten (aide) 

Kindergarten (supplies) 

46* MCLISH 

Remedial programs (reading 

6c math) 

Teacher aides 

Guidance and counseling 

Transportation 



1002 



1-22 



Okfuskee 



Pontotoc 



47. MILL CREEK 

Remedial reading 
Teacher aide 



Johnston 



48, MORRIS 

Teacher aide 



1-3 



Okmulgee 



49. OAKS MISSION 1-5 
Remedial reading (teacher salary) 
Kindergarten (teacher, teacher aide) 

(food, transportation) 
Teacher aides (elementary) 
Guidance & counseling 

50. OLNEY 1-4 
Music (teacher) 

Supplies (music) 

51. PAWHUSKA INDIAN CAMP D-23 
Remedial Reading & Math 

(teacher & teacher aides) 



Delaware 



Coal 



Osage 



52. PEGGS 

Teacher aide 



31 



Cherokee 



53. PLAINVIEW 
Teacher aide 
Counselor 

Equipment & supplies 

54, PRESTON 
Kindergarten (teacher) 
Teacher aides 
Remedial reading 

Art (teacher) 



27 



55 



Carter 



Okmulgee 



55. ROCKY MOUNTAIN 
Teacher aides 

Kindergarten Art & Music & supplies 



24 



Adair 



SCHOOL & PRCX^RAM 



DISlRIC'i 



COUNTY 



5b. RYAL 

ReTTiedial education 
Treacher aides 



D-3 



Mcintosh 



57. SALINA 1-16 
Library aide 

Teacher aides (elementary) 
Counselor 

Special education (not specific) 

58. SALLISAW I-l 
Teacher aides 

Counselor 



Mayes 



Sequoyah 



59. SASAKWA 

Teacher aide (kindergarten) 
Special education (not specified) 
Counseling 

Art (teacher & supplies) 
Reduction of class size 



10 



Seminole 



60. SHADY GROVE 
Teacher aide 



26 



Cherokee 



61. SILO 

Remedial reading (teacher) 



I-l 



Bryan 



62, SKELLY 

Kindergarten (teacher, supplies) 
Teacher aide (special ed.) 



Adair 



63. SMITHVILLE 

Remedial reading & special education 
Teacher aide (to above) 
Bilingual education (elementary) 
Equipment 



14 



McCurtain 



64. STILl^JELL 

Kindergarten (teacher) 
Teacher aides 



T-25 



Adair 



65. STONEWALL 
Counseling 

66. TAHLEQUAH 

Counselor (girls high school) 
Counselor (elementary) 
Arts & crafts (junior high) 



1-30 



1-35 



Pontotoc 



Cherokee 



ERIC 



67. TALIHINA 1-52 LeFlore 

Small group instruction 

Tutorial services counseling 

Equipment &. supplies--reimbursement for 

Indian meals - 1970-71 teachers and teacher aides 



SCHOOL & PROGRAM 

68. TENKILLER 

Kindergarten (teacher) 
Remedial reading (teacher) 
Music 

Teacher aides 



DISTRICT 
66 



COUNTY 
Cherokee 



69. TUPELO 1-2 
Music (teacher) 

Remedial math (teacher) 

Teacher aides (music 6c remedial math) 

70. VIAN 1-2 
Counselor (Inc ian) 

Teacher aides 



Coal 



Sequoyah 



71. WAPANUCKA 

Slow learners 
Teacher aide 



1-37 



Johnston 



72. WELEETKA 
Teacher aides 

73. WESTVILLE 
Teacher aides 



1-31 



I-ll 



Okfuskee 



Adair 



74. WILSON 

Teacher aides 



1-7 



Okmulgee 



75. WRIGHT CITY 1-39 
Kindergarten (teacher) 

Teacher aides 
Supplies 6c equipment 

76. 7J0N 

Kindergarten (teacher) 

Teacher aides (K, 2nd, 3rd, 6c 5th) 

Reduction in class size (not specified) 

Supplies 



McCurtain 



Adair 



ERIC 
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JOHNSON-O'MALLEY SPECIAL PROGRAM EVALUATION 



Please check the blank you think best describes your JOM program. 
In some cases you may wish to attach supplemental information to the 
form. Please feel free to do so and check the box provided for this 
purpose Please label supplemental information according to the num- 
ber of the item on the form. Thank you for your cooperation. 



Name and address of school district 

A, BACKGROUND INFORMATION 

Please check the appropriate Area Office under which your JOM program is 
administered. 

Abe rdeen ^Anadarko Albuquerque Bill ings Juneau 

Minneapol is Muskogee Navajo Phoenix Sacramento 

Southeast (Central Off.) 

Indicate the approximate number of Indian children (JOM eligibles) in 
vour program. 

1 to 25 766 to 100 201 to 300 501 to 1000 

26 to 50 101 to 150 301 to 400 [Over 1000 

51 to 75 151 to 200 ^401 to 500 

Does vour program have a set of written objectives? 

Yes No Supplemental Information attached 

If the response to this item is "yes", please attach a copy of objectives 
to tnis form, 

B PAREOTAL COST TTEMS 

1 «. Was the use of JOM funds for parental cost items resulted in increased 
interest of Indian students in the total educational program? 

Yes No Supplemental Information Attached 

2, If the answer to the above question was "yes", check the item below 
that best describes the manner in which increased interest was ex- 
pressed. 

Supplemental Information Attached 

Dropouts decreased --at tendance improved . 

Students talked more about school and seemed to like it better. 



B. PARKNIAL COST i FpiS 'con't,) 



Parents talked more about the way their children liked school. 
Indian students participated in inore school activit ies--plays , 

band , parties , etc , 
Indian students showed more interest in academic studies--higher 

grades, etc. 

There were fewer behavior problems among Indian students. 

Other. Please describe ^ 



If the answer to the above question was "nc", please check the item 
below that expresses best the decreased interest of Indian students 
in the total education program. 

Supplemental Information Attached 

Dropout increased --poor attendance 

Students talked less about school — seemed to dislike it. 

Parents said their children were more critical of the school- 
seemed to dislike it. 

Indian students participated less in school activities--plays , 

band, sports, etc. 
Other. Please describe 



C. SPECIAL NEED PROGRAMS 

Please indicate the SPECIAL NEED programs funded. If necessary 
please attach supplemental information to explain piogram. 

Special Education Supplemental Information 

B ilingual - Language Arts Attached 

Remedial Programii Cur-riculum Enrichment 

Indian Cultural Arts ^Tutorial Services 



Teacher Aides or similar programs Special Counselors 

"other. Please describe Study Centers 



Has the level of academic achievement of Indian students been raised 
by providing JOM funding for these SPECIAL NEED programs? 

Yes No Supplemental Information Attached 

Do you have standardized test data to support your answer to the above 
question? 

Yes No Supplemental Information Attached 

If such standardized data is available, please supply information to 
show the following: 

Average grade placement for JOM students in each grade. 
Compare this year's average grade placement for these 
students with last year's. 



C. SPECIAL NEED pROGR.\MS (con*t.) 



Compare pre -program test scor».-5 with post-program scores. 
Compare JOM student grade plactment with all students in 
each grade* 

In what ivays can these SPECIAL MEED programs be improved? 

^More personnel needed Supplemental Information 

Better quality personnel needed Attached 

Other, Please describe Better equipment and materials 

needed 



D. HOME AND PARENT BASED PROGRAMS 

Which of the following home and parent based JOM funded programs do you 
have? 

Social Workers Supplemental Information Attached 

Home School Coordinators Home Visitors 

Parent^Student Counselors 

Other. Please describe 



Have ti.3 programs indicated above improved? 

Supplemental Information Attached^ 

Attendance and Retention 

of Students Yes No 

Grades of Students Yes No 

Reduced Behavior Problems Yes No 

Participation of parents in 

school program Yes No 

Other. Please describe 



E. PARENTAL INVOLVEMENT 
Do you have an Indian Education Committee or Advisory School Board? 
Vcs No Supplomf ntal Tnfofmat ion Attached 



How are members of this group selected? 

^Elected by Tribal or Indian group 

Appointed by Tribal Official (s) 

Appointed by school administration 

Selected by PTA 

Other. Please describe 



How does the Indian Committee relate to the elected School Board? 
^They participate in planning and approval of JOM funded programs. 



E. PARENTAL lNVOL\^-:MFNr (con't.) 



They meet regularly with the School Board to determine 

that JOM funds are being spent properly. 
They are furnished information by the School Board, but 

do not participate in decision making. 
Other. Please describe 



F. ADDITIONAL INFORMATION 

Supplemental Information Attached^ 

Please attach any supplemental information you wish to show: 

Behavioral changes 
Improvement in physical skills 
Observations by staff, parents, pupils 
Any other evaluative reports or comments 

Do you feel that the results of your JOM program warrant its con- 
tinuation? 

Yes No 



What are your recommendations for improving the program next year? 

Supplemental Information Attached 

^More Indian participation in planning and in supervision of 

program operation. 
^Less Indian participation in planning and in supervision of 

program operation. 
Program should be expanded by adding: 



These parts of the program 


should be eliminated: 




These program activities should 


be revised : (Please describe) 




No change is needed 




Other. Please describe 







This JOM evaluation form has been completed by: 



School Administrator Date 
(Signature & Title) 



Indian Committee or Advisory 
School Board Member 



Date 



Comments on the Preced i ng Q ue st lonnairc 

The Division of Educational Assistance has recognized the dif- 
ficulty of evaluating the Johnson-O^Malley programs and has aimed at 
perfecting the evaluation schedule over a period of several years. 
Bearing tnis in mind and in a completed sympathetic spirit, I am forced 
to sav that the survey instr'-iment seems to be very weak as it stands 
now- Perhaps its greatest weakness is the absence so far of evidence 
that its development was a result of ::ocperative effort on the part of 
BIA, public school, and tribal representatives. If this is so, then 
there may be a lack of agreement as to what many of the questions really 
mean, such as (B.2) "Students talked more about school and seemed to like 
It better" and "Parents talked more about the way their children liked 
school". Such questions call for highly subjective opinions at best. 

The seven school administrators in eastern Oklahoma who filled out 
this questionnaire provided a glimmer of insight into how lack of back- 
ground can be disastrously misleading. About three of the seven stated 
that parental cost items had decreased dropouts, increased interest in 
academic studies, and lessened behavior problems - even though the State 
of Oklahoma didn' t have a parental cost program. 

There seems to be an assumption that such things as improved attend- 
ance or fewer behavior problems are necessarily a result of the BIA pro- 
viding funds for parental cost items. This seems to be straining it a bit. 
Also under Schedule B there is provision for reporting increased pupil 
interest or decreased pupil interest but no provision for reporting no 
significant change which might very well be the case. 

Schedule C. Special Need Programs relies heavily on standardized 
test data as evidence. This is likely to prove disappointing. Some of 
the schools may give achievement tests and others not (the responses to 
the Muskogee questionnaire indicates that most of them do not), they are 
likely to be different tests, the results of which are not necessarily 
comparable, the results are likely to be reported incompletely , when they 
are available, in a wide variety of different ways, ani, especially in the 
light of the national experience, tae results are likely to fail to show 
any vt rv clear cut change in an/ direction. Ji C ^ 1 can't imagine any 
school official failing to answer t^iest questions in the affirmative. 

Schedule D seems to have the same inherent weaknesses in Schedule 
B. Schedule E Parental Involvement, Indian Education Committees, Indian 
Advisory School Boards, or the Indian Voice is particularly crucial. Co- 
operation between school administrations and such groups is never easy 
and formal reports may be almost valueless unless supported by personal 
interviews with both sides. 

The handling of Supplemental Information, not only under Schedule F 
but all of the other schedules will be the most awkward and cumbersome 
job. Any plan for handling this must await seeing what is sent in. (In 
response to the Muskogee questionnaire, the schools sent in very little). 



Eventually, I supose thought must be given to designing the 
questionnaire in such a way that it can be suitably coded for automat ive 
data processing. 
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